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1. arXiv:2301.01768 [pdf] $ cs.CY 
The political ideology of conversational Al: Converging evidence on ChatGPT's pro- 
environmental, left-libertarian orientation 
Authors: Jochen Hartmann, Jasper Schwenzow, Maximilian Witte 


Abstract: Conversational artificial intelligence (Al) disrupts how humans interact with technology. Recently, OpenAl 
introduced ChatGPT, a state-of-the-art dialogue model that can converse with its human counterparts with 
unprecedented capabilities... v More 

Submitted 5 January, 2023; originally announced January 2023. 


2. arXiv:2301.01743 [pdf] cs.CL 
Chatbots as Problem Solvers: Playing Twenty Questions with Role Reversals 


Authors: David Noever, Forrest McKee 


Abstract: New chat Al applications like ChatGPT offer an advanced understanding of question context and memory 
across multi-step tasks, such that experiments can test its deductive reasoning. This paper proposes a multi-role and 
multi-step challenge, where ChatGPT plays the classic twenty-questions game but innovatively switches... v More 
Submitted 31 December, 2022; originally announced January 2023. 


3. arXiv:2212.14882 [pdf, other] cs.LG 
ChatGPT Makes Medicine Easy to Swallow: An Exploratory Case Study on Simplified Radiology 
Reports 
Authors: Katharina Jeblick, Balthasar Schachtner, Jakob Dexl, Andreas Mittermeier, Anna Theresa StUber, Johanna 
Topalis, Tobias Weber, Philipp Wesp, Bastian Sabel, Jens Ricke, Michael Ingrisch 


Abstract: The release of ChatGPT, a language model capable of generating text that appears human-like and authentic, 
has gained significant attention beyond the research community. We expect that the convincing performance of... v More 
Submitted 30 December, 2022; originally announced December 2022. 


4. arXiv:2212.14548 [pdf, other] 


How would Stance Detection Techniques Evolve after the Launch of ChatGPT? 

Authors: Bowen Zhang, Daijun Ding, Liwen Jing 

Abstract: ...challenges which are insufficient labeled data and information in social media posts and the unexplainable 
nature of deep learning models. A new pre-trained language model chatGPT was launched on Nov 30, 2022. For the 
stance detection tasks, our experiments show that... v More 

Submitted 30 December, 2022; originally announced December 2022. 
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arXiv:2212.11661 [pdf, other] 


The Death of the Short-Form Physics Essay in the Coming Al Revolution 

Authors: Will Yeadon, Oto-Obong Inyang, Arin Mizouri, Alex Peach, Craig Testrow 

Abstract: ...-word) Physics essays within seconds. These technologies such as ChatGPT and davinci-003 are freely 
available to anyone with an internet connection. In this work, we present evidence of Al generated short-form essays 
achieving first-class grades on an essay writing assessment from an accredited, current university Physics module. The 
assessment requires stud... v More 

Submitted 22 December, 2022; originally announced December 2022. 

Comments: 14 pages, 2 figures 


. arXiv:2212.11126 [pdf] cs. cs.CL cs.LG 


Chatbots in a Botnet World 

Authors: Forrest McKee, David Noever 

Abstract: Question-and-answer formats provide a novel experimental platform for investigating cybersecurity questions. 
Unlike previous chatbots, the latest ChatGPT model from OpenAl supports an advanced understanding of complex 
coding questions. The research demonstrates thirteen coding tasks that generally qualify as stages in the MITRE ATT&CK 
framework, ranging... v More 

Submitted 22 December, 2022; v1 submitted 18 December, 2022; originally announced December 2022. 


. arXiv:2212.10522 [pdf, other] 


Transformers Go for the LOLs: Generating (Humourous) Titles from Scientific Abstracts End- 
to-End 

Authors: Yanran Chen, Steffen Eger 

Abstract: We consider the end-to-end abstract-to-title generation problem, exploring seven recent transformer based 
models (including ChatGPT) fine-tuned on more than 30k abstract-title pairs from NLP and machine learning venues. As 
an extension, we also consider the harder problem of generating humorous paper titles. For the latter, we compile the 
first large-scale h... v More 

Submitted 20 December, 2022; originally announced December 2022. 


. arXiv:2212.10474 [pdf, other] 


ByGPT5: End-to-End Style-conditioned Poetry Generation with Token-free Language Models 
Authors: Jonas Belouadi, Steffen Eger 

Abstract: ...and fine-tune it on a large custom corpus of English and German quatrains annotated with our styles. We 
show that ByGPT5 outperforms other models such as mT5, ByT5, GPT-2 and ChatGPT, while also being more parameter 
efficient and performing favorably compared to humans. In addition, we analyze its runtime performance and introspect 
the model's understan... v More 

Submitted 20 December, 2022; originally announced December 2022. 

Comments: Preprint 


. arXiv:2212.09993 [pdf, other] cs.CV cs.LG 


Are Deep Neural Networks SMARTer than Second Graders? 

Authors: Anoop Cherian, Kuan-Chuan Peng, Suhas Lohit, Kevin Smith, Joshua B. Tenenbaum 

Abstract: ... number of applications of deep neural networks towards solving tasks that require superior cognitive 
abilities, e.g., playing Go, generating art, question answering (such as ChatGPT), etc. Such a dramatic progress raises the 
question: how generalizable are neural networks in solving problems that demand broad skills? To answer this question, 
we propose SMART... v More 

Submitted 4 January, 2023; v1 submitted 19 December, 2022; originally announced December 2022. 


arXiv:2212.09292 [pdf, other] cs.CL 
ChatGPT: The End of Online Exam Integrity? 
Authors: Teo Susnjak 


Abstract: This study evaluated the ability of ChatGPT, a recently developed artificial intelligence (Al) agent, to perform 
high-level cognitive tasks and produce text that is indistinguishable from human-generated text. This capacity raises 
concerns about the potential use of... v More 

Submitted 19 December, 2022; originally announced December 2022. 
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arXiv:2212.08104 [pdf] cs.C cs.Al cs.CY 


The Role of Al in Drug Discovery: Challenges, Opportunities, and Strategies 

Authors: Alexandre Blanco-Gonzalez, Alfonso Cabezon, Alejandro Seco-Gonzalez, Daniel Conde-Torres, Paula Antelo- 
Riveiro, Angel Pineiro, Rebeca Garcia-Fandino 

Abstract: ...insights into the challenges and opportunities for realizing its potential in this field. Note from the human- 
authors: This article was created to test the ability of ChatGPT, a chatbot based on the GPT-3.5 language model, to assist 
human authors in writing review articles. The text generated by the Al following our instructions (see Supporting 
Information... v More 

Submitted 8 December, 2022; originally announced December 2022. 

Comments: 11 pages, 1 figure 


arXiv:2212.06933 [pdf, other] cs.Al cs.IR 

Paraphrase Identification with Deep Learning: A Review of Datasets and Methods 

Authors: Chao Zhou, Cheng Qiu, Daniel E. Acuna 

Abstract: The rapid advancement of Al technology has made text generation tools like GPT-3 and ChatGPT increasingly 
accessible, scalable, and effective. This can pose serious threat to the credibility of various forms of media if these 
technologies are used for plagiarism, including scientific literature and news sources. Despite the development of 
automated methods f... v More 


Submitted 13 December, 2022; originally announced December 2022. 
Comments: 36 pages, 2 figures, 6 tables, 173 references 


arXiv:2212.06721 [pdf] | cs.Al cs.CL 


The Turing Deception 

Authors: David Noever, Matt Ciolino 

Abstract: This research revisits the classic Turing test and compares recent large language models such as ChatGPT for 
their abilities to reproduce human-level comprehension and compelling text generation. Two task challenges -- 
summarization, and question answering -- prompt ChatGPT to produce original content (98-99%) from as... v More 
Submitted 23 December, 2022; v1 submitted 9 December, 2022; originally announced December 2022. 


arXiv:2212.05856 [pdf, other] 


"I think this is the most disruptive technology": Exploring Sentiments of ChatGPT Early 
Adopters using Twitter Data 

Authors: Mubin UI Haque, Isuru Dharmadasa, Zarrin Tasnim Sworna, Roshan Namal Rajapakse, Hussain Ahmad 
Abstract: Large language models have recently attracted significant attention due to their impressive performance on a 
variety of tasks. ChatGPT developed by OpenAl is one such implementation of a large, pre-trained language model that 
has gained immense popularity among early adopters, where certain users go to the extent of characterizing it as a 
disruptive technolo... v More 

Submitted 12 December, 2022; originally announced December 2022. 

Comments: This is an early version of this paper 


arXiv:2211.06869 [pdf, other] cs.Al 


What would Harry say? Building Dialogue Agents for Characters in a Story 
Authors: Nuo Chen, Yan Wang, Haiyun Jiang, Deng Cai, Ziyang Chen, Longyue Wang, Jia Li 


Abstract: ...disappoint us in that although the generated responses are fluent, they still seem out of character for Harry. 
Besides, we validate the current most robust dialogue agent, ChatGPT, which also can't generate plausible Harry-Potter- 
like responses in some cases, either. Our results suggest that there is much scope for future research. v More 

Submitted 18 December, 2022; v1 submitted 13 November, 2022; originally announced November 2022. 


Comments: 14 pages 


arXiv:2206.05442 [pdf, other] 


Automatically Answering and Generating Machine Learning Final Exams 

Authors: Sarah Zhang, Reece Shuttleworth, Zad Chin, Pedro Lantigua, Saisamrit Surbehera, Gregory Hunter, Derek 
Austin, Yann Hicke, Leonard Tang, Sathwik Karnik, Darnell Granberry, Iddo Drori 

Abstract: ...with numeric answers, and questions with expression answers, and evaluate a large free language model, 
Meta's OPT, and compare the results with Open Al's GPT-3, ChatGPT, and Codex. A student survey comparing the 


quality, appropriateness, and difficulty of machine-generated questions with human-written questions shows that across 
multiple aspects, mac... v More 


Submitted 23 December, 2022; v1 submitted 11 June, 2022; originally announced June 2022. 
Comments: 17 pages 
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